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@> Image data processing. 



A method and apparatus for processing data representing an image in a first colour space suitable for 
controlling a first image output device. The apparatus comprises a processor (11. 14, 17) for reversibly 
transforming the image into a perceptual colour space defined by lightness, colourful ness and hue 
components, and for modifying the lightness, colourfulness and hue components of the image in 
accordance with a predetermined algorithm so that all colours in the image fall within the gamut of a 
second image output device ; and a store for storing data defining the modified and unmodified 
lightness, colourfulness and hue components. 
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IMAGE DATA PROCESSING 



The invention relates to methods and apparatus 
for processing data representing an image. 

The digital representation of coloured images is 
particularly useful in design systems for architecture, 5 
interior decoration, textiles, graphic arts, and indust- 
rial products. In these applications the user frequently 
has to specify the colour of a final product according 
to what he sees on a display screen. It is important 
therefore that a final "hard copy" version of what is 10 
seen accurately reproduces the colours viewed on the 
screen and vice versa. At present, it is estimated, for 
example, that in some industries there is a wastage of 
up to 30% due to the need to remake hard copies due 
to colour specification problems. 15 

Various different problems of monitor and printer 
displays have been recognised in the past and 
attempts have been made to address these. One par- 
ticular problem is the difference in gamut between dif- 
ferent colour image display devices. For example, a 20 
conventional display monitor will respond to signals 
representing red, green and blue (RGB) colour com- 
ponents while a colour printer will typically respond to 
signals representing cyan, magenta, and yellow 
(CMY) colour components. A problem arises in this 25 
situation because the gamut of colours displayable on 
a display monitor is generally not the same as the 
gamut of colours that can be printed. This is exem- 
plified in Figure 1 which shows the gamut 1 of a typical 
RGB phosphor monitor and the gamut 2 of a CMY 30 
printing process viewed under a D65 illuminant. It will 
be immediately apparent that neither gamut 1, nor 
gamut 2 is a subset of the other, that is the two sets 
of colours are disjoint. This means that some printable 
colours cannot be displayed on a monitor (those out- 35 
side the solid triangle 1 ) and some displayable colours 
cannot be printed (those outside the dotted polygon 
2). 

Various attempts have been made in the past to 
compensate for differences in gamut between output 40 
devices and one such example is described in EP-A- 
0209266. 

The method of US-A-4758885 attempts to apply 
a system for colour gamut compression used in NTSC 
television to the problem of transferring colour from 45 
monitor to ink-jet printer. The input RGB signals are 
converted into CIE L*u*v* coordinates, compressed, 
then converted back into modified RGB by fixed (pre- 
computed) lookup tables in read-only memory (ROM). 
The resultant RGB signals are then converted directly 50 
into CMY for printing. The process is therefore non- 
adjustable except by replacing the ROM, and relies on 
fixed colour characteristics for both monitor phos- 
phors and printing inks. 

The invention of EP-A-321983 consists of a fast 55 
look-up table generator in which a computer takes 



stored corrective functions and generates the con- 
tents of a lookup table that converts RGB input signals 
directly into CMY output signals. The loading of the 
table takes into account first setting the white points 
equal, second conforming the achromatic axes, and 
third truncating colours to the gamut boundary of the 
output printing device. Colour manipulation for the 
purposes of table setup is performed in the CIE L*a*b* 
colour space, though in operation the signals are not 
transformed into this intermediate form. 

Another such method is described in JPA-1- 
130691. 

The main problem with these existing methods is 
that they operate on the original colour components 
which are sensitive to external conditions such as 
ambient illumination and the like and are not adapt- 
able to take account of viewing conditions and the like. 

In accordance with one aspect of the present 
invention, a method of processing data representing 
an image in a first colour space suitable for controlling 
a first image output device comprises reversibly trans- 
forming the image into a perceptual colour space 
defined by lightness, colourfulness and hue compo- 
nents; and modifying the lightness, colourfulness and 
hue components of the image in accordance with a 
predetermined algorithm so that all colours in the 
image fall within the gamut of a second image output 
device. 

In accordance with a second aspect of the pre- 
sent invention, apparatus for processing data repre- 
senting an image in a first colour space suitable for 
controlling a first image output device comprises pro- 
cessing means for reversibly transforming the image 
into a perceptual colour space defined by lightness, 
colourfulness and hue components, and for modifying 
the lightness, colourfulness and hue components of 
the image in accordance with a predetermined 
algorithm so that all colours in the image fall within the 
gamut of a second image output device; and storage 
means for storing data defining the modified and 
unmodified lightness, colourfulness and hue compo- 
nents. 

We have devised a new method and apparatus 
for achieving gamut compensation in which an image 
is reversibly transformed from a first set of colour 
coordinates into a perceptual colour space which can 
then be modified depending upon the device by which 
the image is to be output to take account of the gamut 
of that output device. The advantage of this is that the 
conversion to perceptual colour space automatically 
takes account of true colour appearance which is nor- 
mally affected by viewing conditions such as the level 
and spectral distribution of the light source, also 
ambient illumination, surround, presentation medium 
and the like while the image represented in perceptual 
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colour space will more nearly match the attributes of 
human perception mechanism and thus be much 
easier to assess and modify. 

The predetermined algorithm may implement 
various gamut mapping techniques. For example, a 5 
simple algorithm limits all colours that fall outside 
some common gamut subset to the boundary of that 
subset leaving those colours inside unaltered. These 
algorithms can be easily implemented but may 
change the appearance of the limited colours relative 10 
to the original. Other algorithms involve linear scaling 
of one or more attributes of all colours, both inside and 
outside the common gamut subset. A preferred 
algorithm comprises scaling the lightness component 
by the ratio of the luminance values (L) of the refer- is 
ence white of each device, scaling the colourfulness 
by a related factor, and leaving the hue unchanged. 
This has the effect of preserving the colour appear- 
ance of the entire scene. Other non-linear gamut map- 
ping algorithms are also possible. 20 

A significant advantage of the invention is that the 
predetermined algorithm need not be fixed. Thus in 
one application, the method further comprises 
interactively generating the predetermined algorithm 
by: * 25 

a) displaying the image as represented in percep- 
tual colour space and indicating on the display 
those pixels whose colours fall outside the gamut 
of the second image output device; 

b) generating scaling factors for one or more of 30 
the lightness, colourfulness and hue compo- 
nents; 

c) modifying the image as represented in percep- 
tual colour space in accordance with the scaling 
factors; 35 

d) repeating steps a - c until the displayed image 
is satisfactory; and thereafter, 

e) setting any remaining pixels whose colours fall 
outside the gamut of the second image output 
device to in gamut colours. 40 
The displaying step will typically comprise con- 
verting the image to monitor format colour compo- 
nents and displaying the image on a monitor. 

In another, non-interactive, application, the pre- 
determined algorithm is generated by constructing 45 
histograms of the lightness, colourfulness, and hue 
values of the pixels of the image; generating scaling 
factors for the lightness, colourfulness and hue com- 
ponents so that a proportion of the pixels falling out- 
side the gamut of the second image output device are 50 
brought within the gamut and modifying the image as 
represented in perceptual colour space in accordance 
with the scaling factors; and setting any remaining 
pixels whose colours fall outside the gamut of the sec- 
ond image output device to in gamut colours. 55 

In some cases the proportion will be 100% but 
typically it will be less, for example substantially 90%. 

Various proposals have been made in the past to 



transform an image into perceptual colour space. The 
method we prefer is a colour apperance model (CAM) 
described in a book entitled "Measuring Colour", 
chapter 8 by R.W.G. Hunt (Ellis Horwood, 1987). This 
model takes the CIE tristimuius values XYZ and trans- 
forms them into the perceptual colour space compo- 
nents (LCH), corresponding closely to the perceptual 
attributes of the human visual system. 

Preferably, the step of transforming the image 
into perceptual colour space comprises an initial step 
of representing the image by tristimuius values or a 
function thereof and thereafter transforming the tris- 
timuius values into perceptual colour space, the step 
of generating tristimuius values comprising applying a 
predetermined algorithm which takes account of the 
colour reproduction characteristics of the first image 
output device. 

This preferred method is particularly useful since 
it allows not only the appearance of an image when 
reproduced on a different device to be simulated but 
also predicts the change in appearance of a coloured 
image under various viewing conditions. 

Preferably, the method further comprises trans- 
forming the modified LCH components into a second 
colour space suitable for controlling the second image 
output device. 

For example, the first image output device may 
comprise a CRT monitor while the second image out- 
put device comprises a colour printer. It should be 
understood that one of the particular advantages of 
this invention is that the process can be reversed. 
That is, the second colour space and the first colour 
space may be the same so that following modification 
in perceptual colour space the image can be transfor- 
med back to the first colour space. 

The processing means may be formed by a suit- 
ably programmed computer, hardware circuits or a 
combination of these. 

An example of a method and apparatus according 
to the invention will now be described with reference 
to the accompanying drawings, in which:- 

Figure 1 is a conventional CIE chromaticity diag- 
ram; 

Figure 2 is a block diagram of the apparatus; 
Figures 3A and 3B constitute a flow diagram illus- 
trating operation of the apparatus of Figure 2; 
Figure 4 illustrates a printing device calibration 
cube; 

Figure 5 illustrates graphically a gamut mapping 
process; and 

Figure 6 is a flow diagram illustrating an example 
of interactive operation. 

The apparatus shown in Figure 2 comprises a col- 
our phosphor monitor 1 which responds to red, green, 
and blue control signals to display an image. The 
monitor 1 is controlled by a processor 2 which is coup- 
ted to four image stores 3-5, 8 for storing red, green 
and blue (RGB), tightness, colourfulness and hue 
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(LCH), cyan, magenta, yellow and black (CMYK), and 
tristimulus (XYZ) colour components respectively. 
The processor 2 is connected to a control device 6 
such as a digitizing table to enable operator control 
and to a colour printer 7. The printer 7 responds to 5 
CMYK control signals to print a coloured version of the 
image. 

Initially, parameters characterising the monitor 1 
are 7 " derived by generating a "colour cube" with, for 
example, nine levels spread at approximately uniform 10 
intervals between 0% and 100% colour density for 
each of the three colour primaries RGB of the device, 
giving a total of 729 sample patches. The processor 
2 causes each patch to be displayed by the monitor 1 
at the centre of the screen and this is measured via a 15 
teles pectroradiometer to obtain its emission spectra, 
from which corresponding XYZ tristimulus values can 
be calculated. Interpolation software routines then 
allow XYZ values to be calculated for any inter- 
mediate values of RGB. 20 

In this example, an image is stored in terms of 
RGB colour components in the store 3. This image 
may have been generated by scanning an original 
transparency using a conventional electronic scanner 
or may have been created electronically by the 25 
operator. The RGB image is represented by a refer- 
ence numeral 1 0 in Figure 3A. The operator can view 
the image in the store 3 by suitably controlling the pro- 
cessor 2 which passes the digital pixel data from the 
store 3 to the monitor 1 in a conventional manner. It 30 
will be assumed that the operator wishes to produce 
a "hard copy" version of the displayed image. This will 
be printed by the printer 7 but will require the conver- 
sion of the representation of the image from RGB col- 
our space to CMYK colour space. 35 

Initially, the processor 2 converts the image rep- 
resented in the RGB store 3. pixel by pixel, into the 
equivalent XYZ tristimulus values which are stored in 
the store 8. This conversion can be considered as the 
application of a "forward device model" 11 which res- 40 
ponds to the empirically derived monitor device data 
12 described above. The monitor device data 12 and 
the forward device model 1 1 characterize the monitor 
1 in terms of its colour gamut and transfer function. 

The XYZ image 13 in the store 8 is then transfor- 45 
med via a colour appearance model (CAM) 14, which 
is governed by parameters corresponding to the 
monitor viewing conditions 15, into perceptual LCH 
coordinates 16 stored in the store 4. The CAM 14 is 
a comprehensive model of colour appearance that so 
takes into account the surround and viewing condi- 
tions as well as the colour stimulus values of each col- 
oured area in the image. Factors that are known to 
affect appearance are the luminance level and spec- 
tral power distribution of the light source(s), viewing ss 
geometry (i.e. relative angles and distance of iltumin- 
ant, object and observer), surface texture and gloss, 
type of medium (i.e. luminous or non-luminous), and 



the sensitivity of the observer's visual system. Further 
factors within a scene can affect appearance, such as 
edge quality, size and shape of the area being con- 
sidered, and the lightness and colour of adjacent 
areas and the further surround. 

The CAM takes account of the fact that two col- 
ours having the same tristimulus values (XYZ) do not 
necessarily have the same colour appearance. In 
practice this is true only under very restricted condi- 
tions, namely when colour is reproduced on identical 
media and viewed under identical circumstances. 

A suitable colour appearance model which is 
implemented by the processor 2 is described in the 
text book by R.W.G. Hunt mentioned above. 

In the next stage, the operator, via the input 
device 6, can arrange for the processor2 to modify the 
LCH image 16 so as to take account of the differences 
between the colour gamut of the monitor 1 and the col- 
our gamut of the printer 7 on which the image is to be 
printed. This gamut mapping process is illustrated at 
17 in Figure 3A and responds to monitor and printer 
colour gamut data 1 8. Various mapping techniques 
are possible, as described above, but the preferred 
technique involves a linear mapping. 

The following describes an interactive, hybrid 
method of determining the optimum linear scaling fac- 
tors for lightness and coiourfulness. It combines linear 
scaling and truncation, the breakpoint being deter- 
mined by visual judgement of the operator 

A. Calculate (Step 30, Figure 6) LCH values for 
each pixel via colour appearance model (CAM). 

B. Determine which pixels are outside the com- 
mon gamut subset (Step 31). 

C. Overlay the image displayed on the monitor 
with a suitable graphic indication of which pixels 
are affected, eg. by means of an obvious change 
in visual appearance, such as making them bright 
green or alternating between the normal and 
increased brightness (Step 32). 

D. The operator considers (Step 33) the dis- 
played image (which could be in terms of the origi- 
nal RGB values or obtained by conversion from 
the modified LCH image by reversing the process 
shown in Figure 3A) and if it is not satisfactory 
(e.g. too manytfew out of gamut pixels) selects or 
modifies scaling values by adjustment of the con- 
trol device (Step 34). The L and C coordinates of 
the LCH image are then rescaled accordingly 
(Step 35). 

E. Repeat steps B-D until the operator is satisfied 
with the appearance of the image. 

F. Pixels remaining outside the common gamut 
subset are truncated in coiourfulness to force 
them onto the gamut boundary Step 36). 
Where there is no opportunity for interactive 

adjustment by a human operator, such as in an auto- 
matic printing process from photographic film, the 
breakpoint could be determined from the statistics of 
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the pixels in the image. For example, by constructing 
histograms of the lightness and colourfulness values 
of all pixels that initially fall outside the common gamut 
subset, the scaling factors can be set so that 90% of 
these pixels are brought into gamut 

In both these interactive and non-interactive 
cases, it will be noted that the colours of some pixels 
eventually have to be truncated to the gamut bound- 
ary. This is acceptable since in many cases these col- 
ours are the result of noise in the processing means, 
so that the filtering action of the truncation will be 
beneficial. The colour appearance of an image, 
moreover, is a macroscopic phenomenon and is not 
significantly affected by the modification of isolated 
pixels. 

Figure 5 shows an example of a gamut mapping 
procedure. Lightness (L) is plotted against colourful- 
ness (C) for a given hue angle. The display device 
gamut is first scaled in both L and C by a factor of 
L2/L1 in order to set the reference white levels to the 
same value. The point P represents a colour on the 
boundary of the scaled display gamut, still outside the 
printing device gamut. Three possible strategies for 
truncating the colour to the common gamut subset are 
indicated; limit C at same level of L (P1); limit both L 
and C along a line toward the 50% neutral grey point 
Lg (P2); or limit L at the same level of C (P3). Normally 
the first of these strategies would be preferred 
because it preserves lightness, which most affects the 
appearance of the image. 

The result of the gamut mapping process 17 is a 
modified LCH image 19 which is stored in the store 4. 
This modified LCH image 19 defines the image in 
components with magnitudes which, upon conversion 
to the appropriate colour spaces, fall within the colour 
gamuts of the monitor 1 and the printer 7. In order to 
print that image, it is necessary to reverse the process 
so far and this is illustrated in Figure 3B. 

Firstly, the processor 2 implements an inverse 
colour appearance model 20 responding to print view- 
ing conditions 21 to convert the modified LCH image 
19 to an XYZ image 22 stored in the store 8. The 
inverse colour appearance model 20 is the direct 
inverse of the model 14 and can be derived by refer- 
ence to the text book mentioned above. 

Next, the XYZ tristimulus image 22 is converted 
to a CMY image 23 by applying an inverse device 
model 24 which responds to printer device data 25. 
The inverse device model 24 is similar in form to the 
forward device model 1 1 and takes account of the col- 
our gamut and transfer function of the printer. These 
can be determined in a similar manner to that previ- 
ously described by generating a colour cube with nine 
levels spread at approximately uniform intervals be- 
tween 0% and 100% colour density for each of the 
three colour primaries CMY to give a total of 729 
sample patches. In this case of axbJour printer, nine 
charts (C1-C9, Figure 4) are printed each containing 



9x9 sample patches. The patches are then 
measured individually with a specrophotometer to 
obtain their absorbtion spectra, from which the XYZ 
tristimulus values can be calculated. Interpolation 

5 software routines allow CMY values to be calculated 
from intermediate XYZ values. This CMY image is 
stored in the store 5 and finally a black printer signal 
K is generated using a conventional process 26 such 
as under-colour removal following which the full 

10 CMYK image is stored in the store 5 for use subse- 
quently to control the printer 7. 

In order to check that there are no unprintable col- 
ours, that is outside the gamut of the printing inks, the 
operator may wish to make a "soft proof - on the moni- 

15 tor 1. In this case, the modified LCH image 19 (after 
gamut compression) may be transformed back to XYZ 
and monitor RGB signals, using the monitor viewing 
conditions and cube data. 

20 

Claims 

1. A method of processing data representing an 
image in a first colour space suitable for control- 

25 ling a first image output device, the method com- 
prising reversibly transforming the image into a 
perceptual colour space defined by lightness, col- 
ourfulness and hue components; and modifying 
the lightness, colourfulness and hue components 

30 of the image in accordance with a predetermined 
algorithm so that all colours in the image fall 
within the gamut of a second image output 
device. 

35 2. A method according to claim 1 , wherein the pre- 
determined algorithm limits all colours that fall 
outside a common gamut subset to the boundary 
of that subset leaving those colours inside unal- 
tered. 

40 

3. A method according to claim 1, wherein the pre- 
determined algorithm comprises scaling the light- 
ness component by the ratio of the luminance 
values (L) of the reference white of each device, 

45 scaling the colourfulness by a related factor, and 

leaving the hue unchanged. 

4. A method according to claim 3, wherein the col- 
ourfulness scaling factor varies as a function of 

so hue. 

5. A method according to any of the preceding 
claims, further comprising interactively generat- 
ing the predetermined algorithm by: 

5S a) displaying the image as represented in per- 

ceptual colour space and indicating on the dis- 
play those pixels whose colours fall outside 
the gamut of the second image output device; 
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b) generating scaling factors for one or more 
of the lightness, colourfuiness and hue com- 
ponents; 

c) modifying the image as represented in per- 
ceptual colour space in accordance with the 5 
scaling factors; 

d) repeating steps a - c until the displayed 
image is satisfactory; and thereafter; 

e) setting any remaining pixels whose colours 

fall outside the gamut of the second image 10 
output device to in gamut colours. 

6. A method according to any claims 1 to 3, wherein 
the predetermined algorithm is generated by con- 
structing histograms of the lightness, colourful- 1$ 
ness, and hue values of the pixels of the image; 
generating scaling factors for the lightness, col- 
ourfuiness and hue components so that a propor- 
tion of the pixels falling outside the gamut of the 
second image output device are brought within 20 
the gamut and modifying the image as represen- 
ted in perceptual colour space in accordance with 
the scaling factors; and setting any remaining 
pixels whose colours fall outside the gamut of the 
second image output device to in gamut colours. 25 



ness and hue components, and for modifying the 
lightness, colourfuiness and hue components of 
the image in accordance with a predetermined 
algorithm so that all colours in the image fall 
within the gamut of a second image output 
device; and storage means for storing data defi- 
ning the modified and unmodified lightness, col- 
ourfuiness and hue components. 

12. Apparatus according to claim 1 1 , wherein the pro- 
cessing means is adapted to perform a method 
according to any of claims 1 to 10. 

13. Apparatus according to claim 12, when depen- 
dant on claim 6, further comprising display means 
to allow an operator to judge the effect of the 
gamut mapping, and wherein the control means 
enables the scaling factors to be adjusted. 



7. A method according to claim 6, wherein the pro- 
portion is substantially 90%. 

ft. A method according to any of claims 5 to 7, whe- 30 
rein the final setting step comprises adjusting the 
colourfuiness component while keeping the hue 
and lightness components constant. 



9. A method according to any of the preceding 35 
claims, wherein the step of transforming the 
image into perceptual colour space comprises an 
initial step of representing the image by tris- 
timulus values or a function thereof and thereafter 
transforming the tristtmulus values into percep- 40 
tual colour space, the step of generating tris- 
timulus values comprising applying a 
predetermined algorithm which takes account of 
the colour reproduction characteristics of the first 
image output device. 45 



10. A method according to any of the preceding 
claims, further comprising transforming the mod- 
ified LCH components into a second colour space 
suitable for controlling the second image output so 
device. 



11. Apparatus for processing data representing an 
image in a first colour space suitable for control- 
ling a first image output device, the apparatus 55 
comprising processing means (11, 14, 17) for 
reversibly transforming the image into a percep- 
tual colour space defined by lightness, colourful- 
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